Long short-term memory

Recurrent neural network, Deep learning

• Understanding LSTM Networks
• LSTM Networks for Sentiment Analysis

Batch normalization

• Recurrent Batch Normalization

Libraries

• https://www.quora.com/What-are-some-good-Python-libraries-that-implement-LSTM-networks
• Keras
• TensorFlow

Tutorials

• A noob’s guide to implementing RNN-LSTM using Tensorflow
• Understanding LSTM Networks by Christopher Olah

Visualization

• Visual Analysis of Hidden State Dynamics in Recurrent Neural Networks

References

• Hochreiter1997: The original article
• Cooijmans2016: Recurrent Batch Normalization
• context2vec: Learning Generic Context Embedding with Bidirectional LSTM